Imaging apparatus and image processing method

ABSTRACT

Provided is an apparatus and method that perform display control to avoid a blackout of a display unit at the time of capturing an image for recording. The apparatus includes an imaging element, a frame memory, a display unit, and a control unit, and the control unit starts exposure preparation processing of the image for recording in response to input detection of image-capturing operation on the imaging apparatus, and executes exposure processing of the image for recording in the imaging element and storage processing of the image for recording in the frame memory after completion of the exposure preparation processing. Moreover, the control unit stops exposure of an image for displaying of the imaging element with the start of the exposure preparation processing, and displays the image for displaying on the display unit until display of the image for recording is enabled, to avoid the blackout.

CROSS-REFERENCES TO RELATED APPLICATIONS

The present application is a continuation application of U.S. patentapplication Ser. No. 16/495,258, filed on Sep. 18, 2019, which is aNational Stage Entry of PCT/JP2018/001784 filed on Jan. 22, 2018, whichclaims priority benefit of Japanese Patent Application Nfvo. JP2017-067662, filed in the Japan Patent Office on Mar. 30, 2017. Each ofthe above-referenced applications is hereby incorporated herein byreference in its entirety.

TECHNICAL FIELD

The present disclosure relates to an imaging apparatus, an imageprocessing method, and a program. In particular, the present disclosurerelates to an imaging apparatus, an image processing method, and aprogram that perform display image control of a display unit of theimaging apparatus.

BACKGROUND ART

In a case where image capturing is performed by using a camera (imagingapparatus), many users (image-capturing persons) confirm an imagedisplayed on a display unit such as an LCD display unit or an electricview finder (EVF) of the camera.

For example, the user (image-capturing person) can determine animage-capturing timing by observing the image displayed on the displayunit, and press a release button (shutter button).

Furthermore, the user (image-capturing person) can display the capturedimage on the display unit and confirm the captured image.

In a case where image capturing is not performed, a current imageincident on an imaging element of the imaging apparatus, in other words,a live view image (LV image) is displayed on the display unit of theimaging apparatus. The live view image (LV image) is also referred to asa through image, and the user (image-capturing person) can determine theimage-capturing timing by confirming the live view image (LV image)displayed on the display unit.

In a case where the user (image-capturing person) performsimage-capturing processing, the release button (shutter button) ispressed. Along with this release button operation processing, exposurepreparation processing is started, for example, mode switching of theimaging element, or the like.

However, in many imaging apparatuses, imaging is stopped of the liveview image (LV image) of the imaging element due to the start of theexposure preparation processing, and as a result, a period occurs inwhich nothing is displayed on the display unit. A so-called blackout ofthe display unit occurs. Note that, the blackout of the display unit isdescribed, for example, in Patent Document 1 (Japanese PatentApplication Laid-Open No. 2015-186234).

When the blackout occurs, the user (image-capturing person) cannotconfirm the display image.

Furthermore, there is a possibility that problems occur such as user'sdiscomfort, or misunderstanding that operation mistake has beenperformed due to an influence of the blackout of the display unitgenerated with pressing of the release button.

CITATION LIST Patent Document

Patent Document 1: Japanese Patent Application Laid-Open No. 2008-186234

SUMMARY OF THE INVENTION Problems to be Solved by the Invention

The present disclosure has been made, for example, in view of the aboveproblems, and it is an object to provide an imaging apparatus, an imageprocessing method, and a program enabled to prevent occurrence ofproblems such as user's discomfort, or misunderstanding that operationmistake has been performed due to the blackout of the display unitgenerated with pressing of the release button.

Solutions to Problems

A first aspect of the present disclosure is in

an imaging apparatus including:

an imaging element;

a frame memory that stores an image for displaying acquired by theimaging element;

a display unit that displays the image for displaying stored by theframe memory; and

a control unit that starts exposure preparation processing of an imagefor recording in response to input detection of imaging operation, andperforms display control to cause the display unit to display the imagefor displaying having been stored in the frame memory until display ofthe image for recording is enabled.

Moreover, a second aspect of the present disclosure is in

an image processing method to be executed in an imaging apparatus,

the imaging apparatus including

an imaging element,

a frame memory that stores an acquired image by the imaging element,

a display unit that displays a stored image of the frame memory, and

a control unit that performs control of processing to be executed in theimaging apparatus,

the image processing method including

by the control unit, starting exposure preparation processing of animage for recording in response to input detection of image-capturingoperation, and performing display control to cause the display unit todisplay an image for displaying having been stored in the frame memoryunit until display of the image for recording is enabled.Moreover, a third aspect of the present disclosure is ina program that causes an imaging apparatus to execute image processing,the imaging apparatus includingan imaging element,a frame memory that stores an acquired image by the imaging element,a display unit that displays a stored image of the frame memory, anda control unit that performs control of processing to be executed in theimaging apparatus,the program causing the control unit tostart exposure preparation processing of an image for recording inresponse to input detection of imaging operation, and perform displaycontrol to cause the display unit to display the image for displayinghaving been stored in the frame memory until display of the image forrecording is enabled.

Note that, the program of the present disclosure is, for example, aprogram that can be provided by a communication medium or a storagemedium provided in a computer readable form to a computer system or aninformation processing device that can execute various program codes. Byproviding such a program in a computer readable form, processing isimplemented according to the program on the information processingdevice or the computer system.

Still other objects, features and advantages of the present disclosurewill become apparent from the detailed description based on embodimentsof the present disclosure and attached drawings to be described later.Note that, in this specification, the term “system” refers to a logicalgroup configuration of a plurality of devices, and is not limited to asystem in which the devices of respective configurations are in the samehousing.

Effects of the Invention

According to a configuration of an embodiment of the present disclosure,an apparatus and a method are implemented that perform display controlto avoid the blackout of the display unit at the time of capturing animage for recording.

Specifically, for example, the apparatus includes an imaging element, aframe memory, a display unit, and a control unit, and the control unitstarts exposure preparation processing of an image for recording inresponse to input detection of image-capturing operation on the imagingapparatus, and executes exposure processing of the image for recordingin the imaging element and storage processing of the image for recordingin the frame memory after completion of the exposure preparationprocessing. Moreover, the control unit stops exposure of an image fordisplaying of the imaging element with the start of the exposurepreparation processing, and displays the image for displaying on thedisplay unit until display of the image for recording is enabled, toavoid the blackout.

With these pieces of processing, the apparatus and the method areimplemented that perform display control to avoid the blackout of thedisplay unit at the time of capturing the image for recording.

Note that, the advantageous effects described in this specification aremerely examples, and the advantageous effects of the present technologyare not limited to them and may include additional effects.

BRIEF DESCRIPTION OF DRAWINGS

FIGS. 1A and 1B are diagrams illustrating a data processing sequence incapturing and display processing of an image in an imaging apparatus.

FIGS. 2A, 2B, 2C, 2D, 2E, 2F, 2G, and 2H are diagrams illustrating atiming chart illustrating a processing sequence in a case where an imagefor displaying (LV image) is displayed on a display unit of the imagingapparatus.

FIGS. 3A, 3B, 3C, 3D, 3E, 3F, 3G, and 3H are diagrams illustrating atiming chart illustrating a processing sequence in a case where theimage for displaying (LV image) is displayed on the display unit of theimaging apparatus, and during the display, image-capturing processing isperformed, and recording processing of an image for recording (CAPimage) is performed.

FIG. 4 is a diagram illustrating a configuration example of the imagingapparatus.

FIGS. 5A, 5B, 5C, 5D, 5E, 5F, 5G, and 5H are diagrams illustrating aprocessing sequence according to a first embodiment.

FIGS. 6A and 6B are diagrams illustrating a problem that a release timelag changes depending on timing of image-capturing operation.

FIGS. 7A, 7B, 7C, 7D, 7E, 7F, 7G, and 7H are diagrams illustrating aprocessing sequence according to a second embodiment.

FIGS. 8A, 8B, 8C, 8D, 8E, 8F, 8G, and 8H are diagrams illustrating aprocessing sequence according to a third embodiment.

FIGS. 9A, 9B, 9C, 9D, 9E, 9F, 9G, and 9H are diagrams illustrating aprocessing sequence according to a fourth embodiment.

FIGS. 10A, 10B, 10C, 10D, 10E, 10F, 10G, and 10H are diagramsillustrating a processing sequence according to a fifth embodiment.

FIG. 11 is a flowchart illustrating a processing sequence executed bythe imaging apparatus.

FIG. 12 is a diagram illustrating a configuration example of the imagingapparatus.

MODE FOR CARRYING OUT THE INVENTION

Hereinafter, with reference to the drawings, details will be describedof an imaging apparatus, an image processing method, and a program ofthe present disclosure. Note that, the description will be made inaccordance with the following items.

1. Overview of capturing and display processing of image in imagingapparatus

2. Configuration example of imaging apparatus of the present disclosure

3. Embodiments of imaging apparatus in which blackout of display unit isprevented

3-1. (First embodiment) Embodiment in which blackout of display unit isprevented by starting exposure preparation processing after completionof exposure of image for displaying

3-2. (Second embodiment) Embodiment in which blackout of display unit isprevented by starting exposure preparation processing after lapse ofwaiting time for making release time lag constant after completion ofexposure of image for displaying

3-3. (Third embodiment) Embodiment in which blackout of display unit isprevented by canceling display reservation of unexposed image andperforming continuous display of display image of display unit

3-4. (Fourth embodiment) Embodiment in which blackout of display unit isprevented by continuously displaying the same image on display unit evenafter memory switching, by performing inter frame memory copy of latestimage having been stored in frame memory4. (Fifth embodiment) Embodiment in which it is determined whether ornot period of exposure of image for recording (CAP image) is greaterthan or equal to specified time, and display control is executeddepending on determination result5. Sequence of processing executed by imaging apparatus6. Other embodiments7. Summary of configuration of present disclosure

1. Overview of Capturing and Display Processing of Image in ImagingApparatus

First, with reference to FIGS. 1A and 1B and subsequent drawings, anoverview will be described of capturing and display processing of animage in an imaging apparatus (camera).

FIGS. 1A and 1B illustrate the following processing examples in theimaging apparatus.

FIG. 1A Data processing example at time of non-execution ofimage-capturing processing (at time of execution of live view image (LV)display processing)

FIG. 1B Data processing example at time of execution of image-capturingprocessing (at time of execution of capture image (CAP) recordingprocessing)

Note that, the live view image (LV) is an image displayed on a displayunit of the imaging apparatus, for example, an LCD, an EVF, or the like,which can be confirmed by a user (image-capturing person). It is alsocalled a through image, and is an image continuously displayed on thedisplay unit regardless of execution or non-execution of image-capturingprocessing.

On the other hand, the capture image (CAP) is an image captured by theuser (image-capturing person) operating the release button (shutterbutton) of the imaging apparatus. The captured image (CAP) is recordedin a recording unit (medium) of the imaging measure.

Note that, generally, the capture image (CAP) is acquired and recordedas a high resolution image having a high number of pixels reflecting thenumber of pixels of the imaging element, but the live view image (LV) isacquired and displayed as an image having a low number of pixelsaccording to the number of pixels that can be displayed on the displayunit.

In other words, the live view image (LV) is an image having a lowernumber of pixels than those of the capture image (CAP).

Description will be made for the FIG. 1A data processing example at timeof non-execution of image-capturing processing (at time of execution oflive view image (LV) display processing) illustrated in FIGS. 1A and 1B.

Light incident through an optical lens 11 is incident on an imagingunit, for example, an imaging element 12 including a CMOS image sensoror the like, and image data obtained by photoelectric conversion isoutput. Note that, an output image in this case is an image fordisplaying (LV image) to be displayed on a display unit 21.

Hereinafter, an image to be displayed on the display unit is referred toas an image for displaying or an LV image, while an image forimage-capturing recording is referred to as an image for recording, acapture image, or a CAP image.

When outputting the image for displaying (LV image) to be displayed onthe display unit, the imaging element 12 outputs an image having a lownumber of pixels partially thinned out without outputting all pixel dataof the imaging element.

In a case where the image-capturing processing is executed, it isnecessary to generate an image for recording having a high number ofpixels, so that almost all pixel data of the imaging element is output.

At time of FIG. 1A non-execution of image-capturing processing (at timeof execution of live view image (LV) display processing) illustrated inFIGS. 1A and 1B, the imaging element 12 inputs an output image (LVimage) having a low number of pixels to an AD conversion unit 13.

The AD conversion unit 13 executes A/D conversion of an input signal, inother words, processing of converting an analog signal into a digitalsignal, and stores a digital value after conversion in a frame memory14.

In the example illustrated in the figure, the frame memory 14 has aconfiguration enabled to store two image frames. Captured images of theimaging element 12 are alternately stored in a first frame memory (FM1)and a second frame memory (FM2).

In other words, the frame memory 14 stores two consecutively capturedimage frames simultaneously.

The images stored in the frame memory 14 are sequentially output to asignal processing unit (signal processing LSI) 15 from a precedingstorage frame.

In other words, the images are sequentially output to the signalprocessing unit (signal processing LSI) 15 in accordance with theimage-capturing order alternately from the first frame memory (FM1) andthe second frame memory (FM2).

The signal processing unit 15 executes signal processing in a generalcamera, for example, white balance (WB) adjustment, gamma correction,and the like, to generate an output image, in other words, an image (LVimage) to be displayed on the display unit 21, and stores the image in amemory 16.

The display unit 21 displays the LV image stored in the memory 16.

The display unit 21 includes, for example, an LCD, an EVF, or the like,and can be confirmed by the image-capturing person.

Next, description will be made for the FIG. 1B data processing exampleat time of execution of image-capturing processing (at time of executionof capture image (CAP) recording processing) illustrated in FIGS. 1A and1B.

When the image-capturing person operates (presses) the release button(shutter button), the processing of (2) is performed.

When the image-capturing person operates (presses) the release button(shutter button), light incident through the optical lens 11 is incidenton an imaging unit, for example, the imaging element 12 including a CMOSimage sensor or the like, and exposure processing is started.

However, there is a certain time interval, in other words, a release lag(release time lag), after the release button (shutter button) is presseduntil the exposure processing in the imaging element 12 is started.

Although there is a slight difference depending on the camera, therelease lag is about 15 msec to 30 msec in many cameras.

When the exposure processing in the imaging element 12 ends, the imagingelement 12 outputs the image data obtained by photoelectric conversionto the AD conversion unit 13. Note that, the output image in this caseis an image for recording (CAP image) to be recorded and saved in arecording unit 22.

The image for recording (CAP image) is an image having a high number ofpixels reflecting the number of pixels of the imaging element 12. TheCAP image is an image of a high number of pixels having a larger numberof pixels than those of the image for displaying (LV image) describedwith reference to (1).

In FIGS. 1A and 1B, arrows of the LV image illustrated in FIG. 1A areindicated thin, arrows of the CAP image illustrated in FIG. 11B areindicated thick, and the high/low of the number of pixels is indicatedby the thickness of the arrow.

The AD conversion unit 13 executes A/D conversion of an input signal, inother words, processing of converting an analog signal into a digitalsignal, and stores a digital value after conversion in the frame memory14.

Captured images of the imaging element 12 are alternately stored in thefirst frame memory (FM1) and the second frame memory (FM2).

The images stored in the frame memory 14 are sequentially output to thesignal processing unit (signal processing LSI) 15 from a precedingstorage frame.

In other words, the images are sequentially output to the signalprocessing unit (signal processing LSI) 15 in accordance with theimage-capturing order alternately from the first frame memory (FM1) andthe second frame memory (FM2).

The signal processing unit 15 executes signal processing in a generalcamera, for example, white balance (WB) adjustment, gamma correction,and the like, to generate an output image.

In this case, the signal processing unit 15 generates an image forrecording (CAP image) having a high number of pixels to be stored in therecording unit 22, and moreover, also generates an image for displaying(LV image) to be displayed on the display unit 21 and stores the LVimage in the memory 16. The image for displaying (LV image) is, forexample, an image of a low number of pixels generated by thinningprocessing of the image for recording (CAP image) that is an image of ahigh number of pixels.

The recording unit 22 stores the image for recording (CAP image) havinga high number of pixels stored in the memory 16.

On the other hand, the display unit 21 displays the image for displaying(LV image) having a low number of pixels stored in the memory 16.

The above is the overview of the processing at the time of execution andnon-execution of image capturing in the imaging apparatus.

Next, a temporal flow of these pieces of processing will be describedwith reference to timing charts illustrated in FIGS. 2A, 2B, 2C, 2D, 2E,2F, 2G, and 2H and subsequent drawings.

FIGS. 2A, 2B, 2C, 2D, 2E, 2F, 2G, and 2H are timing charts illustratingprocessing in a period in which image-capturing processing by the user(image-capturing person), in other words, pressing processing of therelease button (shutter button) is not performed, in other words, aprocessing sequence in a case where the image for displaying (LV image)is displayed on the display unit of the imaging apparatus.

Time passes from left to right.

FIGS. 2A, 2B, 2C, 2D, 2E, 2F, 2G, and 2H individually illustrateprocessing timings of the following.

FIG. 2A Imaging element input synchronization signal

FIG. 2B Exposure processing of imaging element and output to framememory

FIG. 2C Stored image of first frame memory (FM1)

FIG. 2D Stored image of second frame memory (FM2)

FIG. 2E Image-capturing operation (release (shutter) operation)

FIG. 2F Processing of control unit

FIG. 2G Display unit input synchronization signal

FIG. 2H Display unit display image

The FIG. 2A imaging element input synchronization signal is asynchronization signal input to the imaging element 12 by control of acontrol unit of the imaging apparatus. In this example, thesynchronization signal for each 16.7 msec is set to be input to theimaging element 12.

The imaging element 12 updates processing to be executed, such as thestart of various types of processing and processing switching, inresponse to input of the synchronization signal.

The FIG. 2B exposure processing of imaging element and output to framememory illustrates the exposure processing in the imaging element 12 andstorage processing of the image after AD conversion for the exposureresult in the frame memory 14.

LV1, LV2, LV3 . . . illustrated in the figure each indicate the exposureprocessing of the image for displaying (LV image) to be displayed on thedisplay unit 21. The exposure processing of each of these images isexecuted for each synchronization signal for each 16.7 msec.

FIG. 2C Stored image of first frame memory (FM1)

FIG. 2D Stored image of second frame memory (FM2)

These illustrate sequences of stored images of the first frame memory(FM1) and the second frame memory (FM2) that are two memory units of theframe memory 14.

As described above, captured images of the imaging element 12 arealternately stored in the first frame memory (FM1) and the second framememory (FM2).

In the example illustrated in the figure, first, the first image fordisplaying (LV1) is stored in the first frame memory (FM1), and the nextimage for displaying (LV2) is stored in the second frame memory (FM2).

Thereafter, the images for displaying (LV3, LV4, LV5 . . . ) arealternately stored in the first frame memory (FM1) and the second framememory (FM2).

The FIG. 2E image-capturing operation (release (shutter) operation)illustrates image-capturing operation by the user (image-capturingperson), in other words, pressing processing of the release button(shutter button).

FIGS. 2A, 2B, 2C, 2D, 2E, 2F, 2G, and 2H are processing sequence in acase where the image-capturing operation by the user (image-capturingperson) is not performed, so that image-capturing operation timing isnot illustrated.

Note that, processing in a case where the image-capturing processing isexecuted will be described later with reference to FIGS. 3A, 3B, 3C, 3D,3E, 3F, 3G, and 3H.

The FIG. 2F processing of control unit illustrates a sequence of controlprocessing executed in the control unit of the imaging apparatus. Notethat, although the control unit is not illustrated in FIGS. 1A and 1Bdescribed above, the imaging apparatus includes the control unit thatperforms control of processing executed by the imaging apparatus inaccordance with a program stored in, for example, a storage unit. Thecontrol unit performs control of processing executed by each componentillustrated in FIGS. 1A and 1B.

The FIG. 2F processing of control unit of FIGS. 2A, 2B, 2C, 2D, 2E, 2F,2G, and 2H illustrates part of various types of processing executed bythe control unit. FIGS. 2A, 2B, 2C, 2D, 2E, 2F, 2G, and 2H mainlyillustrate a sequence of processing relating to control of an image tobe displayed on the display unit.

The figure illustrates rectangular boxes of FM1, FM2, FM1, FM2 . . . asthe sequence of the FIG. 2F processing of control unit.

FM1 represents control of display reservation processing of the latestimage stored in the first frame memory (FM1) and display processing ofdisplaying the latest image stored in the first frame memory (FM1) onthe display unit 21.

FM2 represents control of display reservation processing of the latestimage stored in the second frame memory (FM2) and display processing ofdisplaying the latest image stored in the second frame memory (FM2) onthe display unit 21.

The control unit alternately executes pieces of processing respectivelycorresponding to the frame memories, to FM1, FM2, FM1, FM2 . . . asillustrated in the sequence of the FIG. 2F processing of control unit.In other words, pieces of processing are alternately executed of

(1) display reservation for the first frame memory (FM1) and displayprocessing of the stored image of the first frame memory (FM1), and

(2) display reservation for the second frame memory (FM2) and displayprocessing of the stored image of the second frame memory (FM2).

With this control processing, the stored images of the first framememory (FM1) and the second frame memory (FM2) of the frame memory 14are alternately displayed on the display unit 21.

The FIG. 2G display unit input synchronization signal is asynchronization signal input to the display unit 21 by control of thecontrol unit of the imaging apparatus. The display unit 21 performsprocessing such as switching of display images in response to input ofthe synchronization signal.

The FIG. 2H display unit display image illustrates images displayed onthe display unit 21.

LV1, LV2 . . . correspond to image frames 1 and 2 of the display image,and mean that display frames are switched at a signal interval of thedisplay unit input synchronization signal. In other words, the displayunit 21 displays a moving image by a live view image (through image).

Next, with reference to FIGS. 3A, 3B, 3C, 3D, 3E, 3F, 3G, and 3H,description will be made for processing in a case where image-capturingprocessing by the user (image-capturing person) is performed, in otherwords, pressing processing of the release button (shutter button) isperformed, in other words, a processing sequence in a case where theimage-capturing processing by the user (image-capturing person) isexecuted during a period in which the image for displaying (LV image) isdisplayed on the display unit of the imaging apparatus, and the imagefor recording (CAP image) captured is displayed on the display unit.

Time passes from left to right.

Similarly to FIGS. 2A, 2B, 2C, 2D, 2E, 2F, 2G, and 2H, FIGS. 3A, 3B, 3C,3D, 3E, 3F, 3G, and 3H individually illustrate the processing timings ofthe following.

FIG. 3A Imaging element input synchronization signal

FIG. 3B Exposure processing of imaging element and output to framememory

FIG. 3C Stored image of first frame memory (FM1)

FIG. 3D Stored image of second frame memory (FM2)

FIG. 3E Image-capturing operation (release (shutter) operation)

FIG. 3F Processing of control unit

FIG. 3G Display unit input synchronization signal

FIG. 3H Display unit display image

As illustrated in the vicinity of the center on the line of the FIG. 3Eimage-capturing operation (release (shutter) operation) of FIGS. 3A, 3B,3C, 3D, 3E, 3F, 3G, and 3H, it is assumed that the image-capturingoperation by the user, in other words, the pressing processing of therelease button (shutter button) is performed in step S01.

When the image-capturing operation by the user, in other words, thepressing processing of the release button (shutter button) is performed,the control unit starts exposure preparation processing.

The exposure preparation processing is processing, for example, outputprocessing of control signals to the imaging element and the signalprocessing unit from the control unit, setting processing based on thecontrol signals in the imaging element and the signal processing unit,and the like.

The exposure preparation processing includes, for example, modeswitching processing of the imaging element (image sensor) 12.

When outputting the image for displaying (LV image) to be displayed onthe display unit 21, the imaging element 12 outputs an image having alow number of pixels partially thinned out without outputting all pixeldata of the imaging element.

However, in a case where the image-capturing processing is executed, itis necessary to generate an image for recording having a high number ofpixels, so that almost all pixel data of the imaging element is output.

The exposure preparation processing includes mode switching processingfor changing output data of the imaging element 12, and the like.

When the mode switching processing for changing output data is started,the imaging element 12 has to stop the exposure processing of the imagefor displaying (LV image) and memory output processing.

Note that, although there is a slight difference depending on thecamera, the exposure preparation processing takes a time of about 15msec to 30 msec in many cameras.

As illustrated in the vicinity of the center of the line of the FIG. 3Eimage-capturing operation (release (shutter) operation) of FIGS. 3A, 3B,3C, 3D, 3E, 3F, 3G, and 3H, when the image-capturing operation by theuser, in other words, the pressing processing of the release button(shutter button) is performed in step S01, the control unit startsexposure preparation processing in step S02.

Moreover, with the start of the exposure preparation processing in stepS02, the control unit requests the imaging element 12 to stop theexposure processing of the image for displaying (LV image) and start themode switching in step S03.

In the example illustrated in the figure, the exposure processing isstopped in the middle of the exposure of the image for displaying (LV5).

Moreover, with the start of the exposure preparation processing in stepS02, the control unit requests the display unit 21 to stop the displayimage, in other words, to perform blackout processing, in step S04.

This is because the image for displaying (LV image) to be displayed nextcannot be acquired from the frame memory 14 due to stop of the exposureprocessing of the image for displaying (LV image) by the imaging element12.

In the example illustrated in the figure, the request for stop of thedisplay image, in other words, for the blackout processing is output tothe display unit during display of the image for displaying (LV4), andthe screen of the display unit 21 is switched to the blackout (blackimage output).

Thereafter, when the exposure preparation processing is completed, thecontrol unit notifies the imaging element 12 that the exposurepreparation processing is completed in step S05, and causes the imagingelement 12 to start exposure processing of the image for recording (CAPimage).

In step S06, the imaging element 12 starts the exposure processing ofthe image for recording (CAP image).

The period of exposure is set corresponding to, for example, a periodset by the user, in other words, the shutter speed.

The control unit further executes display reservation of the image forrecording (CAP image) in step S07, and executes display processing ofthe image for recording (CAP image) in step S08.

In other words, the image for recording (CAP image) obtained by theexposure processing of the image for recording (CAP image) by theimaging element 12 in step S06 is stored in the second frame memory(FM2).

This corresponds to that a display reservation sequence executed by thecontrol unit is alternately executed to FM1, FM2, FM1, FM2 . . . , andthe latest display reservation before the start of image capturing ofthe image for recording (CAP image) is issued to the first frame memory(FM1), and the next display reservation is issued to the second framememory (FM2).

The control unit executes display reservation of the image for recording(CAP image) to the second frame memory (FM2) in step S07, and executesprocessing of reading the image for recording (CAP image) from thesecond frame memory (FM2) and displaying the image for recording (CAPimage) on the display unit 21 in step S08.

Note that, in the display processing, processing is performed in whichthinning processing depending on the number of display pixels of thedisplay unit 21 is performed on the image for recording (CAP image)stored in the second frame memory (FM2) and the thinned image isdisplayed.

As understood from the sequence diagram illustrated in FIGS. 3A, 3B, 3C,3D, 3E, 3F, 3G, and 3H, when the image-capturing processing by the user(image-capturing person), in other words, pressing of the release button(shutter button) is performed, the control unit requests the displayunit 21 to stop the display image, in other words, to perform theblackout processing, and the display unit 21 causes the screen to be inthe blackout (black image output).

Thereafter, the blackout (black image output) state is continued in thedisplay unit 21 until the exposure processing of the image for recording(CAP image) and the storage processing in the frame memory 14 are endedand the image for recording (CAP image) can be displayed.

Note that, in the configuration described with reference to FIGS. 1A,1B, 2A, 2B, 2C, 2D, 2E, 2F, 2G, 2H, 3A, 3B, 3C, 3D, 3E, 3F, 3G, and 3H,a usage example has been described of the imaging apparatus includingtwo frame memories; however, a similar blackout occurs even in aconfiguration in which captured images are sequentially stored in oneframe memory.

Hereinafter, embodiments will be described of the present disclosurehaving a configuration in which occurrence of such a blackout of thedisplay unit is prevented.

2. Configuration Example of Imaging Apparatus of Present Disclosure

First, with reference to FIG. 4, a configuration example will bedescribed of an imaging apparatus 100 of the present disclosure.

The imaging apparatus 100 illustrated in FIG. 4 includes an optical lens101, an imaging element 102, an AD conversion unit 103, a frame memory104, a signal processing unit (signal processing LSI) 105, a memory 106,a display unit (LCD/EVF) 107, a recording unit 108, an operation unit109, and a control unit 110.

The frame memory 104 includes a first frame memory (FM1) 121 and asecond frame memory (FM2) 122, and is enabled to store two image frames.

The operation unit 109 is an operation unit for performing user input,for example, a release button (shutter button), setting of animage-capturing aspect and an image-capturing mode, setting of a displayimage of the display unit 107, or the like.

Note that, the display unit 107 can also be made as a touch panel typeand used as a user operation unit.

The control unit 110 inputs control signals and synchronization signalsto components (the imaging element 102, . . . , the recording unit 108),and executes various types of processing control such as control ofexecution timing of processing of each component.

For example, the control unit 110 executes output control of asynchronization signal that defines a processing timing of the imagingelement 102, output control of a synchronization signal that definesswitching timing of the display image of the display unit 107, and thelike.

Specifically, the control unit 110 includes a CPU or the like thatexecutes processing according to a program stored in a storage unit (notillustrated).

The program includes, for example, a control program for imagecapturing, image recording, and image display processing, asynchronization signal output control program, and the like.

Light incident through the optical lens 101 is incident on an imagingunit, for example, an imaging element 102 including a CMOS image sensoror the like, and image data obtained by photoelectric conversion isoutput. Note that, the output image of the imaging element 102 is theimage for displaying (LV image) having a low number of pixels to bedisplayed on the display unit 107 in a case where image-capturingprocessing is not executed, and is the image for recording (CAP image)having a high number of pixels to be stored in the recording unit 108 ina case where the image-capturing processing is executed.

The output image from the imaging element 102 is input to the ADconversion unit 103.

The AD conversion unit 103 executes A/D conversion of an input signal,in other words, processing of converting an analog signal into a digitalsignal, and stores a digital value after conversion in the frame memory104.

In the example illustrated in the figure, the frame memory 104 has aconfiguration enabled to store two image frames. Captured images of theimaging element 102 are alternately stored in the first frame memory(FM1) and the second frame memory (FM2).

In other words, the frame memory 14 stores two consecutively capturedimage frames simultaneously.

The images stored in the frame memory 104 are sequentially output to thesignal processing unit (signal processing LSI) 105 from a precedingstorage frame.

In other words, the images are sequentially output to the signalprocessing unit (signal processing LSI) 105 in accordance with theimage-capturing order alternately from the first frame memory (FM1) andthe second frame memory (FM2).

Note that, although the example illustrated in FIG. 4 includes two framememories, the captured images may be stored sequentially in one framememory.

The signal processing unit 105 executes signal processing in a generalcamera, for example, white balance (WB) adjustment, gamma correction,and the like, to generate the output image, in other words, at least oneof the image for displaying (LV image) to be displayed on the displayunit 107 or the image for recording (CAP image) to be stored in therecording unit 108, and stores the image in the memory 106.

The display unit 107 displays the image for displaying (LV image) storedin the memory 106.

The display unit 107 includes, for example, an LCD, an EVF, or the like,and can be confirmed by the image-capturing person.

Furthermore, the recording unit 108 stores the image for recording (CAPimage) stored in the memory 106.

3. Embodiments of Imaging Apparatus in which Blackout of Display Unit isPrevented

Next, embodiments will be described of an imaging apparatus in which theblackout of the display unit is prevented.

The following embodiments will be sequentially described.

(First embodiment) Embodiment in which blackout of display unit isprevented by starting exposure preparation processing after completionof exposure of image for displaying

(Second embodiment) Embodiment in which blackout of display unit isprevented by starting exposure preparation processing after lapse ofwaiting time for making release time lag constant after completion ofexposure of image for displaying

(Third embodiment) Embodiment in which blackout of display unit isprevented by canceling display reservation of unexposed image andperforming continuous display of display image of display unit

(Fourth embodiment) Embodiment in which blackout of display unit isprevented by continuously displaying the same image on display unit evenafter memory switching, by performing inter frame memory copy of latestimage having been stored in frame memory

3-1. (First Embodiment) Embodiment in which Blackout of Display Unit isPrevented by Starting Exposure Preparation Processing after Completionof Exposure of Image for Displaying

First, as a first embodiment, an embodiment will be described in whichthe blackout of the display unit is prevented by starting exposurepreparation processing after completion of exposure of an image fordisplaying.

FIGS. 5A, 5B, 5C, 5D, 5E, 5F, 5G, and 5H are timing charts illustratinga processing sequence of the first embodiment.

Similarly to FIGS. 3A, 3B, 3C, 3D, 3E, 3F, 3G, and 3H described above,FIGS. 5A, 5B, 5C, 5D, 5E, 5F, 5G, and 5H illustrate a processingsequence in a case where the image for displaying (LV image) isdisplayed on the display unit of the imaging apparatus, and during thedisplay, image-capturing processing by the user (image-capturingperson), in other words, pressing processing of the release button(shutter button) is performed.

Specifically, it is the processing sequence in a case where theimage-capturing processing by the user (image-capturing person) isexecuted during the period in which the image for displaying (LV image)is displayed on the display unit of the imaging apparatus, and the imagefor recording (CAP image) captured is displayed on the display unit.

Time passes from left to right.

Similarly to FIGS. 2A, 2B, 2C, 2D, 2E, 2F, 2G, 2H, 3A, 3B, 3C, 3D, 3E,3F, 3G, and 3H described above, FIGS. 5A, 5B, 5C, 5D, 5E, 5F, 5G, and 5Hindividually illustrate the processing timings of the following.

FIG. 5A Imaging element input synchronization signal

FIG. 5B Exposure processing of imaging element and output to framememory

FIG. 5C Stored image of first frame memory (FM1)

FIG. 5D Stored image of second frame memory (FM2)

FIG. 5E Image-capturing operation (release (shutter) operation)

FIG. 5F Processing of control unit

FIG. 5G Display unit input synchronization signal

FIG. 5H Display unit display image

Hereinafter, pieces of processing will be sequentially described ofprocessing steps S11 to S18 illustrated in FIGS. 5A, 5B, 5C, 5D, 5E, 5F,5G, and 5H.

(Step S11)

First, in step S11, as illustrated in the vicinity of the center of theline of the FIG. 5E image-capturing operation (release (shutter)operation) of FIGS. 5A, 5B, 5C, 5D, 5E, 5F, 5G, and 5H, theimage-capturing operation by the user, in other words, the pressingprocessing of the release button (shutter button) is performed.

(Step S12)

When the image-capturing operation by the user, in other words, thepressing processing of the release button (shutter button) is performedin step S11, the control unit 110 waits until completion of the exposureprocessing of the image for displaying (LV image) during execution bythe imaging element 102 and output processing of exposure data to theframe memory 104 in step S12.

In the example illustrated in FIGS. 5A, 5B, 5C, 5D, 5E, 5F, 5G, and 5H,the image for displaying being in execution of exposure in the imagingelement 102 at the time of execution of the image-capturing operation inS11 is the LV5 image. In step S12, waiting is performed until completionof the exposure processing of the LV5 image and the output processing ofthe exposure data to the frame memory 104.

Note that, the waiting time also includes storage time of the exposuredata to the frame memory 104, in other words, exposure data reading timefrom the imaging element 102.

(Step S13)

After completion of waiting processing in step S12, the control unit 110starts exposure preparation processing in step S13.

The exposure preparation processing is time required for, for example,output processing of control signals to the imaging element 102 and thesignal processing unit 105 from the control unit 110, setting processingbased on the control signals in the imaging element and the signalprocessing unit, and the like.

The exposure preparation processing includes, for example, modeswitching processing of the imaging element 102.

As described above, when outputting the image for displaying (LV image)to be displayed on the display unit 107, the imaging element 102 outputsan image having a low number of pixels partially thinned out withoutoutputting all pixel data of the imaging element 102.

However, in a case where the image-capturing processing is executed, itis necessary to generate an image for recording having a high number ofpixels, so that almost all pixel data of the imaging element 102 isoutput.

The exposure preparation processing includes mode switching processingfor changing output data of the imaging element 102, and the like.

(Step S14)

When the exposure preparation processing is started in step S13, thecontrol unit 110 further makes preparation request for exposure stopprocessing and image for recording (CAP image) exposure processing tothe imaging element 102 in step S14.

The imaging element 102 starts preparation for the image for recording(CAP image) exposure processing, for example, mode switching processingfor changing to output data having a high number of pixels. When thisprocessing is started, the imaging element 102 stops the exposureprocessing of the image for displaying (LV image) and memory outputprocessing.

However, in the present embodiment, the image for displaying (LV5 image)being in execution of exposure by the imaging element 102 at the time ofimage-capturing operation execution has been stored in the first framememory (FM1) by the waiting processing in step S12.

(Step S15)

In step S15, the control unit 110 reads the latest image stored in thefirst frame memory (FM1), in other word, the image for displaying (LV5)in accordance with the display reservation for the first frame memory(FM1) having been executed before the start of the exposure preparationprocessing in step S14, and displays the image on the display unit 107.

The display image is the image for displaying (LV5) stored in the firstframe memory (FM1) during the waiting processing in step S12 describedabove.

(Step S16)

Thereafter, when the exposure preparation processing is completed, thecontrol unit 110 notifies the imaging element 102 that the exposurepreparation processing is completed in step S16, and causes the imagingelement 102 to start exposure processing of the image for recording (CAPimage).

(Step S17)

In step S17, the imaging element 102 starts the exposure processing ofthe image for recording (CAP image).

The period of exposure is set corresponding to, for example, a periodset by the user, in other words, the shutter speed.

(Steps S18 to S19)

The control unit 110 further executes display reservation of the imagefor recording (CAP image) in step S18, and executes display processingof the image for recording (CAP image) in step S19.

Note that, the image for recording (CAP image) obtained by the exposureprocessing of the image for recording (CAP image) by the imaging element102 in step S17 is stored in the second frame memory (FM2).

This corresponds to that the display reservation sequence executed bythe control unit is alternately executed to FM1, FM2, FM1, FM2 . . . ,and the latest display reservation before the start of capturing of theimage for recording (CAP image) is issued to the first frame memory(FM1), and the next display reservation is issued to the second framememory (FM2).

The control unit executes display reservation of the image for recording(CAP image) to the second frame memory (FM2) in step S18, and executesprocessing of reading the image for recording (CAP image) from thesecond frame memory (FM2) and displaying the image for recording (CAPimage) on the display unit 107 in step S19.

Note that, in the display processing, processing is performed in whichthinning processing depending on the number of display pixels of thedisplay unit 107 is performed on the image for recording (CAP image)stored in the second frame memory (FM2) and the thinned image isdisplayed.

As understood from the sequence diagram illustrated in FIGS. 5A, 5B, 5C,5D, 5E, 5F, 5G, and 5H, when the image-capturing processing by the user(image-capturing person), in other words, pressing of the release button(shutter button) is performed, the control unit 110 waits untilcompletion of the exposure processing of the image for displaying (LVimage) during execution by the imaging element 102 and output processingof exposure data to the frame memory 104 in step S12.

In the example illustrated in FIGS. 5A, 5B, 5C, 5D, 5E, 5F, 5G, and 5H,the image for displaying being in execution of exposure in the imagingelement 102 at the time of execution of the image-capturing operation inS11 is the LV5 image. In step S12, waiting is performed until completionof the exposure processing of the LV5 image and the output processing ofthe exposure data to the frame memory 104.

By this waiting processing, the image for displaying (LV5) being exposedcan be stored in the frame memory at pressing timing of the releasebutton (shutter button), and the image for displaying (LV5) can bedisplayed on the display unit 107.

The display processing of the image for displaying (LV5) on the displayunit 107 is continued until the image for recording (CAP image) isstored in the frame memory 104 and can be displayed.

When the image for recording (CAP image) is stored in the frame memory104 and can be displayed, the image for recording (CAP image) is readfrom the frame memory 104 and displayed on the display unit 107 in stepsS18 to S19.

As a result of these pieces of processing, the image for displaying(LV5) being exposed at the time of the image-capturing operationexecution is displayed on the display unit 107 continuously to thedisplay processing of the image for displaying (LV4) before the time ofthe image-capturing operation execution,

and moreover, the image for recording (CAP image) is displayedcontinuously to the display processing of the image for displaying(LV5).

In other words, the image display on the display unit 107 iscontinuously executed without causing the blackout.

Note that, regarding the present embodiment, a processing example hasbeen described in which two frame memories are included; however, in thepresent embodiment, a similar effect can be obtained in a configurationin which captured images are sequentially stored in one frame memory.

3-2. (Second Embodiment) Embodiment in which Blackout of Display Unit isPrevented by Starting Exposure Preparation Processing after Lapse ofWaiting Time for Making Release Time Lag Constant after Completion ofExposure of Image for Displaying

Next, as a second embodiment, an embodiment will be described in whichblackout of the display unit is prevented by starting exposurepreparation processing after the lapse of the waiting time for makingthe release time lag constant after completion of exposure of an imagefor displaying.

The second embodiment is an improved version of the first embodimentdescribed above.

As described above with reference to FIGS. 5A, 5B, 5C, 5D, 5E, 5F, 5G,and 5H, in the first embodiment, waiting is performed until completionof the exposure of the image for displaying (LV image) during executionat the time of the image-capturing operation execution, and after thelapse of the waiting time, the exposure preparation processing of theimage for recording (CAP image) is started, whereby the blackout of thedisplay unit is prevented.

However, if this configuration is adopted, there is a problem that arelease time lag changes to various times, the release time lag being atime from image-capturing operation executed by the user(image-capturing person), in other words, pressing operation of therelease button to the exposure start of the image for recording (CAPimage) that is a captured image corresponding to the image-capturingoperation.

The release time lag will be briefly described.

There is a certain time lag (time delay) until the release button(shutter button) is pressed and the exposure processing of the imagingelement of the camera is actually started.

This time lag is called a release time lag or a release lag.

Although there is a slight difference in the release time lag dependingon the camera, the release lag is within a time range of about 15 msecto 30 msec in many cameras.

In one camera, the release time lag is a constant time, for example, 20msec.

In a case where a stationary subject not moving is image-captured, nosignificant change occurs between the subject at the timing when therelease button (shutter button) is pressed and the subject after thelapse of the release time lag, so that a subject image intended by theimage-capturing person can be recorded as a recorded image in the memoryof the camera.

However, for example, in a case where a subject moving at high speed iscaptured, the subject at the timing when the release button (shutterbutton) is pressed may be largely different from the subject after thelapse of the release time lag. In such a case, an image different fromthe subject image intended by the image-capturing person is recorded inthe memory of the camera.

A general user performs image capturing without paying attention to therelease time lag, but for example, a professional image-capturing personor the like often performs image-capturing processing in considerationof the release time lag of the camera used. In other words, the displayimage of the display unit such as the LCD display unit or the electricview finder (EVF) of the camera is confirmed, and moreover, the releaselag is considered, and then the release button (shutter button) ispressed at a pressing timing.

Specifically, image-capturing processing is performed in which thedisplay image of the display unit of the camera is confirmed, andmoreover, an image after the lapse of the release time lag is estimated,and then the release button (shutter button) is pressed at a timingimmediately before the image estimated so that the image estimated canbe captured.

However, to capture an image assumed by the image-capturing person bycontrolling the pressing timing of the release button (shutter button)in this way is under the condition that the time of the release time lagis always constant.

If the time of the release time lag differs depending on the releasebutton pressing timing, advanced image capturing in consideration of therelease time lag cannot be performed, and image capturing of an imageintended by the image-capturing person becomes difficult.

As described above, to capture the image intended by the image-capturingperson, it is required to make the release time lag constant.

As described above, in the first embodiment described above withreference to FIGS. 5A, 5B, 5C, 5D, 5E, 5F, 5G, and 5H, waiting isperformed until completion of the exposure of the image for displaying(LV image) during execution at the time of the image-capturing operationexecution, and after the lapse of the waiting time, the exposurepreparation processing of the image for recording (CAP image) isstarted, whereby the blackout of the display unit is prevented. However,in this configuration, the release time lag changes, which is the timefrom the pressing operation of the release button by the user(image-capturing person) to the exposure start of the image forrecording (CAP image) corresponding to the image-capturing operation.

This problem will be described with reference to FIGS. 6A and 6B.

FIGS. 6A and 6B illustrate the following two processing examples towhich the first embodiment described above with reference to FIGS. 5A,5B, 5C, 5D, 5E, 5F, 5G, and 5H are applied.

(1) Case where image-capturing operation is executed immediately beforeexposure end of image for displaying (LV5)

(2) Case where image-capturing operation is executed at time of exposurestart of image for displaying (LV5)

In a case where the first embodiment described above with reference toFIGS. 5A, 5B, 5C, 5D, 5E, 5F, 5G, and 5H are applied to the case of FIG.6A, the waiting time is a time from the time of image-capturingoperation to the exposure end of the image for displaying (LV5), and isa time from t11 to t12 illustrated in the figure.

The release time lag in this case is a time (t11 to t13) obtained byadding an exposure preparation processing period (t12 to t13) to thewaiting time (t11 to t12). Note that, as described above, although theexposure preparation processing period varies depending on the imagingapparatus, the period is a constant time, for example, 20 msec, in onecamera.

In the case of FIG. 6A, the exposure preparation processing period (t12to t13) is this 20 msec, and the release time lag (t11 to ta3) is a timeobtained by adding the waiting time (t11 to t12) to this 20 msec.

On the other hand, in a case where the first embodiment described abovewith reference to FIGS. 5A, 5B, 5C, 5D, 5E, 5F, 5G, and 5H are appliedto the case of FIG. 6B, the waiting time is a time from the time ofimage-capturing operation to the exposure end of the image fordisplaying (LV5), and is a time from t21 to t22 illustrated in thefigure.

The release time lag in this case is a time (t21 to t23) obtained byadding an exposure preparation processing period (t22 to t23) to thewaiting time (t21 to t22).

In the cases of FIGS. 6A and 6B, both the exposure preparationprocessing period (t12 to t13) of the case FIG. 5A and the exposurepreparation processing period (t22 to t23) of the case FIG. 5B are thesame with each other, and, for example, 20 msec.

However, the waiting time (t11 to t12) of the case FIG. 5A is a timefrom the time (t11) of the start of the image-capturing operationimmediately before the exposure end of the image for displaying (LV5) tothe time (t12) at which the exposure of the image for displaying (LV5)ends and the image is stored in the memory, and is set shorter than thatof the case of FIG. 6B as understood from the figure.

The waiting time (t21 to t22) of the case of FIG. 6B is a time from thetime (t21) of the start of the image-capturing operation at the time ofthe exposure start of the image for displaying (LV5) to the time (t22)at which the exposure of the image for displaying (LV5) ends and theimage is stored in the memory, and is set longer than that of the caseof FIG. 6B as understood from the figure.

As a result, when both of FIGS. 6A and 6B are compared with each other,the release time lag (t21 to t23) of the case of FIG. 6B is longer thanthe release time lag (t11 to t13) of the case of FIG. 6B.

As described above, in a case where the first embodiment described withreference to FIGS. 5A, 5B, 5C, 5D, 5E, 5F, 5G, and 5H are applied, aproblem occurs that the release time lag differs depending on the timingof the image-capturing operation of the user (image-capturing person).

The second embodiment described below is an embodiment in which thispoint is improved and the release time lag is made constant regardlessof the timing of the image-capturing operation of the user(image-capturing person).

Specifically, the waiting time is set assuming that it is the assumedlongest time, in other words, similarly to the case illustrated in FIG.6B the image-capturing operation is executed at the time of the exposurestart of the image for displaying (LV image). By performing such settingof the waiting time, the release time lag can be made constant.

With reference to FIGS. 7A, 7B, 7C, 7D, 7E, 7F, 7G, and 7H, descriptionwill be made for the second embodiment, in other words, the embodimentin which the blackout of the display unit is prevented by startingexposure preparation processing after the lapse of the waiting time formaking the release time lag constant after completion of exposure of animage for displaying.

FIGS. 7A, 7B, 7C, 7D, 7E, 7F, 7G, and 7H are timing charts illustratinga processing sequence of the second embodiment.

Similarly to FIGS. 5A, 5B, 5C, 5D, 5E, 5F, 5G, and 5H described above,FIGS. 7A, 7B, 7C, 7D, 7E, 7F, 7G, and 7H illustrate the processingsequence in a case where the image for displaying (LV image) isdisplayed on the display unit of the imaging apparatus, and during thedisplay, image-capturing processing by the user (image-capturingperson), in other words, pressing processing of the release button(shutter button) is performed.

Specifically, the figure illustrates the processing sequence in a casewhere the image-capturing processing by the user (image-capturingperson) is executed during the period in which the image for displaying(LV image) is displayed on the display unit of the imaging apparatus,and the image for recording (CAP image) captured is displayed on thedisplay unit.

Time passes from left to right.

Similarly to FIGS. 5A, 5B, 5C, 5D, 5E, 5F, 5G, and 5H described above,FIGS. 7A, 7B, 7C, 7D, 7E, 7F, 7G, and 7H individually illustrate theprocessing timings of the following.

FIG. 7A Imaging element input synchronization signal

FIG. 7B Exposure processing of imaging element and output to framememory

FIG. 7C Stored image of first frame memory (FM1)

FIG. 7D Stored image of second frame memory (FM2)

FIG. 7E Image-capturing operation (release (shutter) operation)

FIG. 7F Processing of control unit

FIG. 7G Display unit input synchronization signal

FIG. 7H Display unit display image

Hereinafter, pieces of processing will be sequentially described ofprocessing steps S21 to S28 illustrated in FIGS. 7A, 7B, 7C, 7D, 7E, 7F,7G, and 7H.

(Step S21)

First, in step S21, as illustrated in the vicinity of the center of theline of the FIG. 7E image-capturing operation (release (shutter)operation) of FIGS. 7A, 7B, 7C, 7D, 7E, 7F, 7G, and 7H, theimage-capturing operation by the user, in other words, the pressingprocessing of the release button (shutter button) is performed.

(Step S22)

When the image-capturing operation by the user, in other words, thepressing processing of the release button (shutter button) is performedin step S21, the control unit 110 waits until a predefined waiting timeelapses in step S22.

The predefined waiting time is a waiting time according to the casedescribed above with reference to FIG. 6B. In other words, assuming thatthe image-capturing operation is performed at the time of the exposureprocessing start of the image for displaying (LV image) in the imagingelement 102, a time required for the exposure processing and the outputprocessing to the frame memory 104 of one image for displaying (LVimage) is taken as the waiting time.

The waiting time also includes storage time of the exposure data to theframe memory 104, in other words, exposure data reading time from theimaging element 102, and moreover, in the second embodiment, differentfrom the first embodiment described above, it is set such that exposurepreparation processing of the image for recording is started afterwaiting for an exposure time for the exposure of one frame even in acase where the exposure in the middle of exposure is completed.

In other words, the waiting time of the second embodiment is madeconstant regardless of the timing of the image-capturing operation.

With this processing, the release time lag, in other words, the timefrom the image-capturing operation to the exposure start of the imagefor recording (CAP image) corresponding to the image-capturing operationis (constant waiting time)+(constant exposure preparation processingtime), and is always constant.

(Step S23)

After completion of the waiting processing in step S22, the control unit110 starts exposure preparation processing in step S23.

The exposure preparation processing is time required for, for example,output processing of control signals to the imaging element 102 and thesignal processing unit 105 from the control unit 110, setting processingbased on the control signals in the imaging element and the signalprocessing unit, and the like.

The exposure preparation processing includes, for example, modeswitching processing of the imaging element 102.

As described above, when outputting the image for displaying (LV image)to be displayed on the display unit 107, the imaging element 102 outputsan image having a low number of pixels partially thinned out withoutoutputting all pixel data of the imaging element 102.

However, in a case where the image-capturing processing is executed, itis necessary to generate an image for recording having a high number ofpixels, so that almost all pixel data of the imaging element 102 isoutput.

The exposure preparation processing includes mode switching processingfor changing output data of the imaging element 102, and the like.

(Step S24)

When the exposure preparation processing is started in step S23, thecontrol unit 110 further makes preparation request for exposure stopprocessing and image for recording (CAP image) exposure processing tothe imaging element 102 in step S24.

The imaging element 102 starts preparation for the image for recording(CAP image) exposure processing, for example, mode switching processingfor changing to output data having a high number of pixels. When thisprocessing is started, the imaging element 102 stops the exposureprocessing of the image for displaying (LV image) and memory outputprocessing.

However, also in the second embodiment, similarly to the firstembodiment described above with reference to FIGS. 5A, 5B, 5C, 5D, 5E,5F, 5G, and 5H, the image for displaying (LV5 image) being in executionof exposure by the imaging element 102 at the time of theimage-capturing operation execution has been stored in the first framememory (FM1) by the waiting processing in step S22.

(Step S25)

In accordance with a display reservation for the first frame memory(FM1) having been executed before the start of the exposure preparationprocessing in step S24, the control unit 110 reads the latest imagestored in the first frame memory (FM1), in other word, the image fordisplaying (LV5), and displays the image on the display unit 107 in stepS25.

The display image is the image for displaying (LV5) stored in the firstframe memory (FM1) during the waiting processing in step S22 describedabove.

(Step S26)

Thereafter, when the exposure preparation processing is completed, thecontrol unit 110 notifies the imaging element 102 that the exposurepreparation processing is completed in step S26, and causes the imagingelement 102 to start exposure processing of the image for recording (CAPimage).

(Step S27)

In step S27, the imaging element 102 starts the exposure processing ofthe image for recording (CAP image).

The period of exposure is set corresponding to, for example, a periodset by the user, in other words, the shutter speed.

(Steps S28 to S29)

The control unit 110 further executes display reservation of the imagefor recording (CAP image) in step S28, and executes display processingof the image for recording (CAP image) in step S29.

As understood from the sequence diagram illustrated in FIGS. 7A, 7B, 7C,7D, 7E, 7F, 7G, and 7H, when the image-capturing processing by the user(image-capturing person), in other words, pressing of the release button(shutter button) is performed, the control unit 110 performs the waitingprocessing for the predefined waiting time in step S22.

In other words, waiting is performed for a constant waiting timecorresponding to the time required for the exposure processing and theoutput processing (storage processing) to the frame memory 104 of oneimage for displaying (LV image).

With this processing, the release time lag, in other words, the timefrom the image-capturing operation to the exposure start of the imagefor recording (CAP image) corresponding to the image-capturing operationis (constant waiting time)+(constant exposure preparation processingtime), and is always constant.

Furthermore, also in the second embodiment illustrated in FIGS. 7A, 7B,7C, 7D, 7E, 7F, 7G, and 7H, similarly to the first embodiment describedabove with reference to FIGS. 5A, 5B, 5C, 5D, 5E, 5F, 5G, and 5H, theimage for displaying being in execution of exposure in the imagingelement 102 at the time of execution of the image-capturing operation inS21 is the LV5 image, and the image for displaying (LV5) being exposedat the pressing timing of the release button (shutter button) is storedin the frame memory within the waiting time in step S22, and the imagefor displaying (LV5) can be displayed on the display unit 107.

The display processing of the image for displaying (LV5) on the displayunit 107 is continued until the image for recording (CAP image) isstored in the frame memory 104 and can be displayed.

When the image for recording (CAP image) is stored in the frame memory104 and can be displayed, the image for recording (CAP image) is readfrom the frame memory 104 and displayed on the display unit 107 in stepsS28 to S29.

Note that, in the display processing, processing is performed in whichthinning processing depending on the number of display pixels of thedisplay unit 107 is performed on the image for recording (CAP image)stored in the second frame memory (FM2) and the thinned image isdisplayed.

As a result of these pieces of processing, the image for displaying(LV5) being exposed at the image-capturing operation execution isdisplayed on the display unit 107 continuously to the display processingof the image for displaying (LV4) before the time of image-capturingoperation execution,

and moreover, the image for recording (CAP image) is displayedcontinuously to the display processing of the image for displaying(LV5).

In other words, the image display is continuously executed on thedisplay unit 107 without causing the blackout.

Note that, regarding the present embodiment, a processing example hasbeen described in which two frame memories are included; however, in thepresent embodiment, a similar effect can be obtained in a configurationin which captured images are sequentially stored in one frame memory.

3-3. (Third Embodiment) Embodiment in which Blackout of Display Unit isPrevented by Canceling Display Reservation of Unexposed Image andPerforming Continuous Display of Display Image of Display Unit

Next, as a third embodiment, an embodiment will be described in whichthe blackout of the display unit is prevented by canceling a displayreservation of an unexposed image and performing continuous display of adisplay image of the display unit.

FIGS. 8A, 8B, 8C, 8D, 8E, 8F, 8G, and 8H are timing charts illustratinga processing sequence of the third embodiment.

Similarly to FIGS. 5A, 5B, 5C, 5D, 5E, 5F, 5G, and 5H described above,FIGS. 8A, 8B, 8C, 8D, 8E, 8F, 8G, and 8H illustrate the processing in acase where the image for displaying (LV image) is displayed on thedisplay unit of the imaging apparatus, and during the display,image-capturing processing by the user (image-capturing person), inother words, pressing processing of the release button (shutter button)is performed.

In other words, the figure illustrates the processing sequence in a casewhere the image-capturing processing by the user (image-capturingperson) is executed during the period in which the image for displaying(LV image) is displayed on the display unit of the imaging apparatus,and the image for recording (CAP image) captured is displayed on thedisplay unit.

Time passes from left to right.

Similarly to FIGS. 5A, 5B, 5C, 5D, 5E, 5F, 5G, and 5H described above,FIGS. 8A, 8B, 8C, 8D, 8E, 8F, 8G, and 8H individually illustrate theprocessing timings of the following.

FIG. 8A Imaging element input synchronization signal

FIG. 8B Exposure processing of imaging element and output to framememory

FIG. 8C Stored image of first frame memory (FM1)

FIG. 8D Stored image of second frame memory (FM2)

FIG. 8E Image-capturing operation (release (shutter) operation)

FIG. 8F Processing of control unit

FIG. 8G Display unit input synchronization signal

FIG. 8H Display unit display image

Hereinafter, pieces of processing will be sequentially described ofprocessing steps S31 to S38 illustrated in FIGS. 8A, 8B, 8C, 8D, 8E, 8F,8G, and 8H.

(Step S31)

First, in step S31, as illustrated in the vicinity of the center of theline of the FIG. 8E image-capturing operation (release (shutter)operation) of FIGS. 8A, 8B, 8C, 8D, 8E, 8F, 8G, and 8H, theimage-capturing operation by the user, in other words, the pressingprocessing of the release button (shutter button) is performed.

(Step S32)

When the image-capturing operation by the user, in other words, thepressing processing of the release button (shutter button) is performedin step S31, the control unit 110 starts exposure preparation processingin step S32.

The exposure preparation processing is processing similar to that in thefirst and second embodiments described above. It is time required for,for example, output processing of control signals to the imaging element102 and the signal processing unit 105 from the control unit 110,setting processing based on the control signals in the imaging elementand the signal processing unit, and the like.

The exposure preparation processing includes, for example, modeswitching processing of the imaging element 102.

(Step S33)

When the exposure preparation processing is started in step S32, thecontrol unit 110 further makes preparation request for exposure stopprocessing and image for recording (CAP image) exposure processing tothe imaging element 102 in step S33.

The imaging element 102 starts preparation for the image for recording(CAP image) exposure processing, for example, mode switching processingfor changing to output data having a high number of pixels. When thisprocessing is started, the imaging element 102 stops the exposureprocessing of the image for displaying (LV image) and memory outputprocessing.

In the third embodiment, as illustrated in FIGS. 8A, 8B, 8C, 8D, 8E, 8F,8G, and 8H, the image being in execution of exposure by the imagingelement 102 at the time of image-capturing operation execution is animage for displaying (LV5 image), and in the middle of this period ofexposure, the imaging element 102 stops the exposure processing of theimage for displaying (LV5) and the memory output processing.

(Step S34)

In the third embodiment, in step S34, the control unit 110 performsprocessing in which the exposure processing is stopped halfway, and adisplay reservation is canceled of the image for displaying (LV5) thatis not stored in the frame memory.

The display reservation to be canceled is a display reservation executedimmediately before the image-capturing operation in step S31. This is adisplay reservation performed at the time of an imaging elementsynchronization signal (ta5) illustrated in FIGS. 8A, 8B, 8C, 8D, 8E,8F, 8G, and 8H.

This display reservation is a display reservation for the image fordisplaying (LV5) to be stored in the first frame memory.

By the display reservation canceling processing, the display processingto be performed according to the display reservation performed at thetime of the imaging element synchronization signal (ta5) illustrated inFIGS. 8A, 8B, 8C, 8D, 8E, 8F, 8G, and 8H, in other words, acquisition ofimage data from the first frame memory (FM1) of the image for displaying(LV5) to be stored in the first frame memory (FM1) and output processingto the display unit 107 are not performed.

As a result of this processing cancellation, the display unit 107continues display of the image displayed before the display timing ofthe image for displaying (LV5), in other words, the image for displaying(LV4) acquired from the second frame memory (FM2).

(Step S35)

Thereafter, when the exposure preparation processing is completed, thecontrol unit 110 notifies the imaging element 102 that the exposurepreparation processing is completed in step S35, and causes the imagingelement 102 to start exposure processing of the image for recording (CAPimage).

(Step S36)

In step S36, the imaging element 102 starts the exposure processing ofthe image for recording (CAP image).

The period of exposure is set corresponding to, for example, a periodset by the user, in other words, the shutter speed.

(Steps S37 to S38)

The control unit 110 further executes display reservation of the imagefor recording (CAP image) in step S37, and executes display processingof the image for recording (CAP image) in step S38.

As understood from the sequence diagram illustrated in FIGS. 8A, 8B, 8C,8D, 8E, 8F, 8G, and 8H, in the FIG. 8H display unit display image, thedisplay period of the image for displaying (LV4) acquired from thesecond frame memory (FM2) is set long, and after the display of thisimage for displaying (LV4), the image for recording (CAP image) iscontinuously displayed.

In other words, in the present embodiment, the display processing of theimage for displaying (LV4) on the display unit 107 is continued untilthe image for recording (CAP image) is stored in the frame memory 104and can be displayed.

When the image for recording (CAP image) is stored in the frame memory104 and can be displayed, the image for recording (CAP image) is readfrom the frame memory 104 and displayed on the display unit 107 in stepsS37 to S38.

Note that, in the display processing, processing is performed in whichthinning processing depending on the number of display pixels of thedisplay unit 107 is performed on the image for recording (CAP image)stored in the second frame memory (FM2) and the thinned image isdisplayed.

As a result of these pieces of processing, the image for recording (CAPimage) is displayed on the display unit 107 continuously to the displayprocessing of the image for displaying (LV4) before the time ofimage-capturing operation execution.

In other words, the image display is continuously executed on thedisplay unit 107 without causing the blackout.

Note that, regarding the present embodiment, a processing example hasbeen described in which two frame memories are included; however, in thepresent embodiment, a similar effect can be obtained in a configurationin which captured images are sequentially stored in one frame memory.

3-4. (Fourth Embodiment) Embodiment in which Blackout of Display Unit isPrevented by Continuously Displaying the Same Image on Display Unit Evenafter Memory Switching, by Performing Inter Frame Memory Copy of LatestImage Having been Stored in Frame Memory

Next, as a fourth embodiment, an embodiment will be described in whichthe blackout of the display unit is prevented by continuously displayingthe same image on the display unit even after memory switching, byperforming inter frame memory copy of the latest image having beenstored in the frame memory.

FIGS. 9A, 9B, 9C, 9D, 9E, 9F, 9G, and 9H are timing charts illustratinga processing sequence of the fourth embodiment.

Similarly to FIGS. 5A, 5B, 5C, 5D, 5E, 5F, 5G, and 5H described above,FIGS. 9A, 9B, 9C, 9D, 9E, 9F, 9G, and 9H are the processing sequence ina case where the image for displaying (LV image) is displayed on thedisplay unit of the imaging apparatus, and during the display,image-capturing processing by the user (image-capturing person), inother words, pressing processing of the release button (shutter button)is performed.

In other words, the figure illustrates the processing sequence in a casewhere the image-capturing processing by the user (image-capturingperson) is executed during the period in which the image for displaying(LV image) is displayed on the display unit of the imaging apparatus,and the image for recording (CAP image) captured is displayed on thedisplay unit.

Time passes from left to right.

Similarly to FIGS. 5A, 5B, 5C, 5D, 5E, 5F, 5G, and 5H described above,FIGS. 9A, 9B, 9C, 9D, 9E, 9F, 9G, and 9H individually illustrate theprocessing timings of the following.

FIG. 9A Imaging element input synchronization signal

FIG. 9B Exposure processing of imaging element and output to framememory

FIG. 9C Stored image of first frame memory (FM1)

FIG. 9D Stored image of second frame memory (FM2)

FIG. 9E Image-capturing operation (release (shutter) operation)

FIG. 9F Processing of control unit

FIG. 9G Display unit input synchronization signal

FIG. 9H Display unit display image

Hereinafter, pieces of processing will be sequentially described ofprocessing steps S41 to S49 illustrated in FIGS. 9A, 9B, 9C, 9D, 9E, 9F,9G, and 9H.

(Step S41)

First, in step S41, as illustrated in the vicinity of the center of theline of the FIG. 9E image-capturing operation (release (shutter)operation) of FIGS. 9A, 9B, 9C, 9D, 9E, 9F, 9G, and 9H, theimage-capturing operation by the user, in other words, the pressingprocessing of the release button (shutter button) is performed.

(Step S42)

When the image-capturing operation by the user, in other words, thepressing processing of the release button (shutter button) is performedin step S41, the control unit 110 starts exposure preparation processingin step S42.

The exposure preparation processing is processing similar to those inthe embodiments described above. It is time required for, for example,output processing of control signals to the imaging element 102 and thesignal processing unit 105 from the control unit 110, setting processingbased on the control signals in the imaging element and the signalprocessing unit, and the like.

The exposure preparation processing includes, for example, modeswitching processing of the imaging element 102.

(Step S43)

When the exposure preparation processing is started in step S42, thecontrol unit 110 further makes preparation request for exposure stopprocessing and image for recording (CAP image) exposure processing tothe imaging element 102 in step S43.

The imaging element 102 starts preparation for the image for recording(CAP image) exposure processing, for example, mode switching processingfor changing to output data having a high number of pixels. When thisprocessing is started, the imaging element 102 stops the exposureprocessing of the image for displaying (LV image) and memory outputprocessing.

In the fourth embodiment, as illustrated in FIGS. 9A, 9B, 9C, 9D, 9E,9F, 9G, and 9H, the image being in execution of exposure by the imagingelement 102 at the time of image-capturing operation execution is animage for displaying (LV5 image), and in the middle of this period ofexposure, the imaging element 102 stops the exposure processing of theimage for displaying (LV5) and the memory output processing.

(Steps S44 to S45)

In the fourth embodiment, in step S44, the control unit 110 executesprocessing of copying the latest image for displaying (LV4) stored inthe second frame memory (FM2) to the first frame memory (FM1).

The image for displaying (LV) to be copied is the latest image fordisplaying having been stored in the frame memory 104 at the time ofexposure stop in step S43.

In the example illustrated in FIGS. 9A, 9B, 9C, 9D, 9E, 9F, 9G, and 9H,it is the image for displaying (LV4) stored in the second frame memory(FM2).

Processing is executed of copying the latest image for displaying (LV4)to the first frame memory (FM1) that is another frame memory.

As a result of this copy processing, in display processing (step S45)according to the display reservation executed immediately before theimage-capturing processing in step S41, in other words, the displayreservation for the image for displaying (LV5) to be stored in the firstframe memory, display processing of the image for displaying (LV4) isperformed on the display unit 107.

In other words, in step S45, the image for displaying (LV4) copied andstored in the first frame memory (FM1) is read from the first framememory (FM1), output to the display unit 107, and displayed.

As a result, at the time of an imaging element synchronization signal(ta4) illustrated in FIGS. 9A, 9B, 9C, 9D, 9E, 9F, 9G, and 9H, first,the image for displaying (LV4) is read from the first frame memory (FM1)and displayed on the display unit 107. Next, at the time of an imagingelement synchronization signal (ta5) illustrated in FIGS. 9A, 9B, 9C,9D, 9E, 9F, 9G, and 9H, copy data of the image for displaying (LV4) isread from the second frame memory (FM2) and displayed on the displayunit 107.

As described above, the image for displaying (LV4) is sequentially readfrom the two frame memories (FM1, FM2) and continuously displayed on thedisplay unit.

(Step S46)

Thereafter, when the exposure preparation processing is completed, thecontrol unit 110 notifies the imaging element 102 that the exposurepreparation processing is completed in step S46, and causes the imagingelement 102 to start exposure processing of the image for recording (CAPimage).

(Step S47)

In step S47, the imaging element 102 starts the exposure processing ofthe image for recording (CAP image).

The period of exposure is set corresponding to, for example, a periodset by the user, in other words, the shutter speed.

(Steps S48 to S49)

The control unit 110 further executes display reservation of the imagefor recording (CAP image) in step S48, and executes display processingof the image for recording (CAP image) in step S49.

As understood from the sequence diagram illustrated in FIGS. 9A, 9B, 9C,9D, 9E, 9F, 9G, and 9H, in the FIG. 9H display unit display image, theimage for displaying (LV4) acquired from the second frame memory (FM2)and the image for displaying (LV4) that is the copied image acquiredfrom the first frame memory (FM1) are continuously displayed longer thanthe original image frame display period, and after the display of theimage for displaying (LV4), the image for recording (CAP image) iscontinuously displayed.

In other words, in the present embodiment, the display processing of theimage for displaying (LV4) on the display unit 107 is continued untilthe image for recording (CAP image) is stored in the frame memory 104and can be displayed.

When the image for recording (CAP image) is stored in the frame memory104 and can be displayed, the image for recording (CAP image) is readfrom the frame memory 104 and displayed on the display unit 107 in stepsS48 to S49.

Note that, in the display processing, processing is performed in whichthinning processing depending on the number of display pixels of thedisplay unit 107 is performed on the image for recording (CAP image)stored in the second frame memory (FM2) and the thinned image isdisplayed.

As a result of these pieces of processing, the image for recording (CAPimage) is displayed on the display unit 107 continuously to the displayprocessing of the image for displaying (LV4) before the time ofimage-capturing operation execution.

In other words, the image display is continuously executed on thedisplay unit 107 without causing the blackout.

4. (Fifth Embodiment) Embodiment in which it is Determined Whether ornot Period of Exposure of Image for Recording (CAP Image) is Greaterthan or Equal to Specified Time, and Display Control is ExecutedDepending on Determination Result

Next, as a fifth embodiment, an example will be described in which it isdetermined whether or not the period of exposure of the image forrecording (CAP image) is greater than or equal to a specified time, anddisplay control is executed depending on the determination result.

The fifth embodiment is an embodiment in which, for example, the controlunit inputs the period of exposure of the image for recording set by theuser (image-capturing person), in other words, the user's shutter speedinformation defining the period of exposure, and in the control unit, itis determined whether or not the period of exposure of the image forrecording (CAP image) is greater than or equal to the specified time,and display control is executed depending on the determination result.

Specifically, in a case where the period of exposure of the image forrecording (CAP image) is greater than or equal to the specified time,the blackout is caused on the display unit 107, and after the exposureof the image for recording (CAP image) is completed and the image isstored in the frame memory, a transition is made from the blackout stateto the image for recording (CAP image) display.

On the other hand, in a case where the period of exposure of the imagefor recording (CAP image) is not greater than or equal to the specifiedtime, the processing of any of the first to fourth embodiments describedabove is executed to execute display processing without the blackout.

In all of the first to fourth embodiments described above, the image fordisplaying (LV4) or the image for displaying (LV5) is set to bedisplayed on the display unit 107 longer than the time of the originalswitching timing of the image for displaying, and when such continuousdisplay of the same image becomes long, the user may misunderstand thatthe moving image display is switched to the still image display.

An image displayed on the display unit 107 by image-capturing operationis displayed as a still image, and the user (image-capturing person)confirms the captured image by the still image displayed on the displayunit.

However, if the image for displaying (LV4) or the image for displaying(LV5), which should originally be displayed as a moving image, iscontinuously displayed for a long time before that, this still image maybe misidentified as a captured image.

To prevent such misidentification processing from occurring, in thefifth embodiment, in a case where the period of exposure of the imagefor recording (CAP image) is greater than or equal to the specifiedtime, the blackout is caused on the display unit 107, and after theexposure of the image for recording (CAP image) is completed and theimage is stored in the frame memory, a transition is made from theblackout state to the image for recording (CAP image) display.

FIGS. 10A, 10B, 10C, 10D, 10E, 10F, 10G, and 10H are timing chartsillustrating a processing sequence of the fourth embodiment.

Similarly to FIGS. 5A, 5B, 5C, 5D, 5E, 5F, 5G, and 5H described above,FIGS. 10A, 10B, 10C, 10D, 10E, 10F, 10G, and 10H illustrate theprocessing sequence in a case where the image for displaying (LV image)is displayed on the display unit of the imaging apparatus, and duringthe display, image-capturing processing by the user (image-capturingperson), in other words, pressing processing of the release button(shutter button) is performed.

In other words, the figure illustrates the processing sequence in a casewhere the image-capturing processing by the user (image-capturingperson) is executed during the period in which the image for displaying(LV image) is displayed on the display unit of the imaging apparatus,and the image for recording (CAP image) captured is displayed on thedisplay unit.

Time passes from left to right.

Similarly to FIGS. 5A, 5B, 5C, 5D, 5E, 5F, 5G, and 5H described above,FIGS. 10A, 10B, 10C, 10D, 10E, 10F, 10G, and 10H individually illustratethe processing timings of the following.

FIG. 10A Imaging element input synchronization signal

FIG. 10B Exposure processing of imaging element and output to framememory

FIG. 10C Stored image of first frame memory (FM1)

FIG. 10D Stored image of second frame memory (FM2)

FIG. 10E Image-capturing operation (release (shutter) operation)

FIG. 10F Processing of control unit

FIG. 10G Display unit input synchronization signal

FIG. 10H Display unit display image

Hereinafter, pieces of processing will be sequentially described ofprocessing steps S51 to S58 illustrated in FIGS. 10A, 10B, 10C, 10D,10E, 10F, 10G, and 10H.

(Step S51)

First, in step S51, as illustrated in the vicinity of the center of theline of the FIG. 10E image-capturing operation (release (shutter)operation) of FIGS. 10A, 10B, 10C, 10D, 10E, 10F, 10G, and 10H, theimage-capturing operation by the user, in other words, the pressingprocessing of the release button (shutter button) is performed.

(Step S52)

When the image-capturing operation by the user, in other words, thepressing processing of the release button (shutter button) is performedin step S51, the control unit 110 starts exposure preparation processingin step S52.

The exposure preparation processing is processing similar to those inthe embodiments described above. It is time required for, for example,output processing of control signals to the imaging element 102 and thesignal processing unit 105 from the control unit 110, setting processingbased on the control signals in the imaging element and the signalprocessing unit, and the like.

The exposure preparation processing includes, for example, modeswitching processing of the imaging element 102.

(Step S53)

When the exposure preparation processing is started in step S52, thecontrol unit 110 further makes preparation request for exposure stopprocessing and image for recording (CAP image) exposure processing tothe imaging element 102 in step S53.

The imaging element 102 starts preparation for the image for recording(CAP image) exposure processing, for example, mode switching processingfor changing to output data having a high number of pixels. When thisprocessing is started, the imaging element 102 stops the exposureprocessing of the image for displaying (LV image) and memory outputprocessing.

In the fifth embodiment, as illustrated in FIGS. 10A, 10B, 10C, 10D,10E, 10F, 10G, and 10H, the image being in execution of exposure by theimaging element 102 at the time of image-capturing operation executionis an image for displaying (LV5 image), and in the middle of this periodof exposure, the imaging element 102 stops the exposure processing ofthe image for displaying (LV5) and the memory output processing.

(Step S54)

In the fifth embodiment, in step S54, the control unit 110 determineswhether or not the period of exposure of the image for recording (CAPimage) is greater than or equal to the specified time, and in a casewhere it is determined that the exposure time is greater than or equalto the specified time, makes a blackout processing request to thedisplay unit 107.

Note that, the period of exposure of the image for recording (CAP image)is determined by inputting image-capturing setting information of theuser (image-capturing person), specifically, the shutter speed. Thespecified time is a preset time and is stored in the memory.

Note that, in a case where it is determined that the period of exposureof the image for recording (CAP image) is not greater than or equal tothe specified time, the blackout processing request to the display unit107 is not made, and the processing of any of the first to fourthembodiments described above is executed.

(Step S55)

Thereafter, when the exposure preparation processing is completed, thecontrol unit 110 notifies the imaging element 102 that the exposurepreparation processing is completed in step S55, and causes the imagingelement 102 to start exposure processing of the image for recording (CAPimage).

(Step S56)

In step S56, the imaging element 102 starts the exposure processing ofthe image for recording (CAP image).

The period of exposure is set corresponding to, for example, a periodset by the user, in other words, the shutter speed.

(Steps S57 to S58)

The control unit 110 further executes display reservation of the imagefor recording (CAP image) in step S57, and executes display processingof the image for recording (CAP image) in step S58.

As understood from the sequence diagram illustrated in FIGS. 10A, 10B,10C, 10D, 10E, 10F, 10G, and 10H, the FIG. 10H display unit displayimage is caused to black out after a display period of the image fordisplaying (LV4) acquired from the second frame memory (FM2), andthereafter, when the image for recording (CAP image) is stored in theframe memory 104 and can be displayed, the image for recording (CAPimage) is read from the frame memory 104 and displayed on the displayunit 107 in steps S57 to S58.

Note that, in the display processing, processing is performed in whichthinning processing depending on the number of display pixels of thedisplay unit 107 is performed on the image for recording (CAP image)stored in the second frame memory (FM2) and the thinned image isdisplayed.

Note that, the blackout processing is executed only in a case where itis determined in step S54 that the period of exposure of the image forrecording (CAP image) is greater than or equal to the specified time.

In a case where it is determined that the period of exposure of theimage for recording (CAP image) is not greater than or equal to thespecified time, the blackout processing request to the display unit 107is not made, and the processing is executed of any of the first tofourth embodiments described above.

As a result of these pieces of processing, the blackout of the displayunit 107 can be caused only in a case where the period of exposure ofthe image for recording (CAP image) is greater than or equal to thespecified time.

With this processing, in a case where the period of exposure of theimage for recording (CAP image) is greater than or equal to thespecified time, the image for displaying (LV image) is displayed as astill image for a long time, and the misidentification processing can beavoided such as the user's (image-capturing person's) misunderstandingthat the display image is the captured image.

Note that, regarding the present embodiment, a processing example hasbeen described in which two frame memories are included; however, in thepresent embodiment, a similar effect can be obtained in a configurationin which captured images are sequentially stored in one frame memory.

5. Sequence of Processing Executed by Imaging Apparatus

Next, an image display control sequence executed by the control unit ofthe imaging apparatus will be described with reference to a flowchartillustrated in FIG. 11.

The flow illustrated in FIG. 11 is a flow illustrating an image displaycontrol sequence corresponding to the processing according to the fifthembodiment described above with reference to FIGS. 10A, 10B, 10C, 10D,10E, 10F, 10G, and 10H.

In other words, it is a flow describing the image display controlsequence in the case of a setting in which, in a case where it isdetermined that the period of exposure of the image for recording (CAPimage) is greater than or equal to the specified time, the blackoutprocessing is performed, and in a case where the period of exposure ofthe image for recording (CAP image) is not greater than or equal to thespecified time, the blackout processing is not performed and theprocessing of any of the first to fourth embodiments described above isexecuted.

The flow illustrated in FIG. 11 is executed in accordance with a programstored in advance in, for example, the storage unit of the imagingapparatus 100 under the control of the control unit 110 including aprocessor having a program execution function.

Hereinafter, processing of each step will be described sequentially.

(Step S101)

First, in step S101, the control unit 110 of the imaging apparatus 100determines whether or not image-capturing processing is executed, inother words, whether or not the release button is pressed by the user(image-capturing person). This is performed as input detectionprocessing from the operation unit 109 in the control unit 110.

In a case where it is determined that the image-capturing processing(release button pressing) is executed, the processing proceeds to stepS102, and in a case where it is determined that the image-capturingprocessing (release button pressing) is not executed, the processingproceeds to step S111.

(Step S111)

First, processing will be described in a case where it is determined instep S101 that the image-capturing processing (release button pressing)is not executed.

In a case where it is determined in step S101 that the image-capturingprocessing (release button pressing) is not executed, the processingproceeds to step S111, and the control unit 110 performs switching ofthe display image frame at a predefined interval to perform displayprocessing of the image for displaying (LV image).

(Step S102)

In a case where it is determined in step S101 that the image-capturingprocessing (release button pressing) is executed, the processingproceeds to step S102, and the control unit 110 determines in step S102whether or not the period of exposure of the image for recording (CAPimage) corresponding to the image-capturing operation detected in stepS101 is greater than or equal to a threshold value (specified time).

Note that, as described above, the period of exposure of the image forrecording (CAP image) is determined by inputting the image-capturingsetting information of the user (image-capturing person), specificallythe shutter speed. The threshold value (specified time) is a preset timeand is stored in the memory.

In a case where it is determined in step S102 that the period ofexposure is not greater than or equal to the threshold value (specifiedtime), the processing proceeds to step S103, and in a case where it isdetermined that the period of exposure is equal to or greater than thethreshold value (specified time), the processing proceeds to step S105.

(Step S103)

In a case where it is determined in step S102 that the period ofexposure is not greater than or equal to the threshold value (specifiedtime), the processing proceeds to step S103.

In this case, the control unit 110 executes the processing in which theblackout of the display unit 107 is avoided, specifically, theprocessing of any of the first to fourth embodiments described above,and executes the exposure preparation processing, and after completionof the exposure preparation processing, starts exposure of a capturedimage (image for recording (CAP image)).

Here, the processing is executed of any of the first to fourthembodiments described above, in other words, display control is executedaccording to any of the following embodiments in which the blackout ofthe display unit is prevented.

The following embodiments will be sequentially described.

(First embodiment) Embodiment in which blackout of display unit isprevented by starting exposure preparation processing after completionof exposure of image for displaying

(Second embodiment) Embodiment in which blackout of display unit isprevented by starting exposure preparation processing after lapse ofwaiting time for making release time lag constant after completion ofexposure of image for displaying

(Third embodiment) Embodiment in which blackout of display unit isprevented by canceling display reservation of unexposed image andperforming continuous display of display image of display unit

(Fourth embodiment) Embodiment in which blackout of display unit isprevented by continuously displaying the same image on display unit evenafter memory switching, by performing inter frame memory copy of latestimage having been stored in frame memory

By executing any of these pieces of processing, image display iscontinuously performed on the display unit 107, and image display thatdoes not cause the blackout is performed.

(Step S104)

In step S103, when the exposure preparation processing is completed andthe exposure of the captured image (image for recording (CAP image)) isstarted, next, it is determined in step S104 whether or not the exposureprocessing and storage processing in the frame memory 104 of thecaptured image (image for recording (CAP image)) is completed.

In a case where it is determined that the processing is completed, theprocessing proceeds to step S107.

(Step S107)

In step S107, the captured image (image for recording (CAP image))stored in the frame memory 104 is read and displayed on the display unit107.

In a case where the processing in steps S103 to S104 to S107 isperformed, the display unit 107 displays the image for displaying (LVimage) and then the captured image (image for recording (CAP image))without causing the blackout.

(Step S105)

Next, processing will be described in step S105 and subsequent steps ina case where it is determined in step S102 that the period of exposureis greater than or equal to the threshold value (specified time).

In this case, in step S105, the control unit 110 executes the blackoutprocessing of the display unit 107 and starts exposure preparationprocessing, and after completion of the exposure preparation processing,starts exposure of the captured image (image for recording (CAP image)).

This is the processing with the blackout of the fifth embodimentdescribed above with reference to FIGS. 10A, 10B, 10C, 10D, 10E, 10F,10G, and 10H. This processing is executed only in a case where theperiod of exposure of the captured image (image for recording (CAPimage)) is greater than or equal to the specified time.

If the processing of the first to fourth embodiments is performed in acase where the period of exposure of the captured image (image forrecording (CAP image)) is long, the image for displaying (LV image) isdisplayed as a still image for a long time, and misidentificationprocessing may occur such as the user's (image-capturing person's)misunderstanding that the display image is the captured image, and oneof the reasons for performing the blackout is to avoid this.

(Step S106)

In step S105, when the exposure preparation processing is completed andthe exposure of the captured image (image for recording (CAP image)) isstarted, next, it is determined in step S106 whether or not the exposureprocessing and storage processing in the frame memory 104 of thecaptured image (image for recording (CAP image)) is completed.

In a case where it is determined that the processing is completed, theprocessing proceeds to step S107.

(Step S107)

In step S107, the captured image (image for recording (CAP image))stored in the frame memory 104 is read and displayed on the display unit107.

In a case where the processing in steps S105 to S106 to S107 isperformed, the display unit 107 stops displaying the image fordisplaying (LV image) and causes the blackout, and then displays thecaptured image (image for recording (CAP image)).

6. Other Embodiments

Next, other embodiments will be described.

An example has been described above of the imaging apparatus thatexecutes the processing of the present disclosure with reference to FIG.4.

The processing of the present disclosure is also applicable to animaging apparatus having a configuration different from theconfiguration of the imaging apparatus 100 illustrated in FIG. 4.

FIG. 12 illustrates a configuration example of an imaging apparatus 200having a configuration different from the configuration illustrated inFIG. 4 enabled to execute the processing of the present disclosure.

The imaging apparatus 200 illustrated in FIG. 12 includes an opticallens 101, an imaging element device 210, a signal processing unit(signal processing LSI) 105, a memory 106, a display unit (LCD/EVF) 107,a recording unit 108, an operation unit 109, and a control unit 110.

The configuration other than the imaging element device 210 is similarto the configuration described above with reference to FIG. 4.

The imaging element device 210 of the imaging apparatus 200 illustratedin FIG. 12 includes an imaging element 211, an AD conversion unit 212,and a frame memory 213.

Light incident through the optical lens 101 is incident on the imagingelement 211 of the imaging element device 210, for example, the imagingelement 211 including a CMOS image sensor or the like, and the imagingelement 211 outputs image data obtained by photoelectric conversion tothe AD conversion unit 212 included in the imaging device 210.

The AD conversion unit 212 in the imaging device 210 executes A/Dconversion of an input signal, in other words, processing of convertingan analog signal into a digital signal, and stores a digital value afterconversion in the frame memory 213 included in the same imaging device210.

The frame memory 213 is enabled to store two image frames, and includesa first frame memory (FM1) 251 and a second frame memory (FM2) 252.Images are alternately stored in these two frame memories.

Image data are output from the two frame memories to the signalprocessing unit (signal processing LSI) 105 in the image-capturingorder.

The signal processing unit (signal processing LSI) 105 inputs the imagedata from the frame memory 213 and performs signal processing.

Subsequent processing is the processing similar to the processing of theimaging apparatus 100 described above with reference to FIG. 4.

The imaging apparatus 200 illustrated in FIG. 12 is characterized inthat the imaging device 210 including the imaging element 211, the ADconversion unit 212, and the frame memory 213 is included.

A control signal and a synchronization signal are input from the controlunit 110 to the imaging device 210, and update processing is performed,such as start, change, and end of processing, on the basis of thesynchronization signal.

Also in the configuration illustrated in FIG. 12, the processing can beperformed according to the timing charts and flowcharts of FIGS. 5A, 5B,5C, 5D, 5E, 5F, 5G, 5H, 6A, 6B, 6C, 6D, 6E, 6F, 6G, 6H, 7A, 7B, 7C, 7D,7E, 7F, 7G, 7H, 8A, 8B, 8C, 8D, 8E, 8F, 8G, 8H, 9A, 9B, 9C, 9D, 9E, 9F,9G, 9H, 10A, 10B, 10C, 10D, 10E, 10F, 10G, 10H, and 11 described above.

7. Summary of Configuration of Present Disclosure

In the above, the embodiments of the present disclosure have beendescribed in detail with reference to specific embodiments. However, itis self-evident that those skilled in the art can make modifications andsubstitutions of the embodiments without departing from the gist of thepresent disclosure. In other words, the present invention has beendisclosed in the form of exemplification, and should not be interpretedrestrictively. To determine the gist of the present disclosure, thescope of claims should be taken into consideration.

Note that, the technology disclosed in this specification can have thefollowing configuration.

-   -   (1) An imaging apparatus including:

an imaging element;

a frame memory that stores an image for displaying acquired by theimaging element;

a display unit that displays the image for displaying stored by theframe memory; and

a control unit that starts exposure preparation processing of an imagefor recording in response to input detection of imaging operation, andperforms display control to cause the display unit to display the imagefor displaying having been stored in the frame memory unit until displayof the image for recording is enabled.

-   -   (2) The imaging apparatus according to (1), in which the control        unit executes exposure processing of the image for recording in        the imaging element and storage processing of the image for        recording acquired by the exposure processing in the frame        memory, after completion of the exposure preparation processing        of the image for recording.    -   (3) The imaging apparatus according to (2), in which

the control unit

switches a display image of the display unit to display the image forrecording from the image for displaying, after an end of the exposureprocessing of the image for recording and the storage processing of theimage for recording in the frame memory.

-   -   (4) The imaging apparatus according to any of (1) to (3), in        which

the control unit

starts the exposure preparation processing of the image for recording ata time of input detection of the image-capturing operation, and stopsexposure processing in the imaging element of the image for displaying.

-   -   (5) The imaging apparatus according to any of (1) to (4), in        which

the control unit

executes waiting processing of waiting for a time required to completeexposure of the image for displaying being exposed in the imagingelement at a time of input detection of the image-capturing operation,and starts the exposure preparation processing of the image forrecording after completion of waiting, and

performs display control to display, on the display unit, the image fordisplaying having been exposed during the waiting processing and havingbeen stored in the frame memory until the display of the image forrecording is enabled.

-   -   (6) The imaging apparatus according to any of (1) to (5), in        which

the control unit

executes waiting processing of waiting for a time required to completeexposure processing of one image frame for displaying from a time ofinput detection of the image-capturing operation, and starts theexposure preparation processing of the image for recording after thewaiting processing, and

performs display control to cause the display unit to display the imagefor displaying having been exposed during the waiting processing andhaving been stored in the frame memory until the display of the imagefor recording is enabled.

-   -   (7) The imaging apparatus according to any of (1) to (6), in        which

the control unit

performs processing of canceling latest display reservation processinghaving been executed before input of the image-capturing operation, inresponse to input detection of the image-capturing operation, and

performs display control to avoid a blackout of the display unit, bycontinuing display processing of an image for displaying on the displayunit executed corresponding to display reservation processing beforedisplay reservation processing to be cancelled, until the display of theimage for recording is enabled.

-   -   (8) The imaging apparatus according to any of (1) to (7), in        which

the frame memory includes two frame memories enabled to store two imageframes, and

the control unit

executes processing of copying and storing a latest image for displayingstored in one of the two frame memories in the other frame memory, inresponse to input detection of the image-capturing operation, and

performs display control to avoid a blackout of the display unit, byalternately reading an identical image for displaying from the two framememories and displaying the image for displaying on the display unit,until the display of the image for recording is enabled.

-   -   (9) The imaging apparatus according to any of (1) to (8), in        which

the control unit

determines whether or not a period of exposure executed in the imagingelement in response to the image-capturing operation is greater than orequal to a threshold value set in advance, and

performs display control to avoid a blackout of the display unit in acase where it is determined that the period of exposure is not greaterthan or equal to the threshold value.

-   -   (10) The imaging apparatus according to any of (1) to (9), in        which

the control unit

determines whether or not the period of exposure executed in the imagingelement in response to the image-capturing operation is greater than orequal to the threshold value set in advance, and

performs display control to cause a blackout on the display unit withoutavoiding the blackout in a case where it is determined that the periodof exposure is greater than or equal to the threshold value.

-   -   (11) The imaging apparatus according to (10), in which

the control unit

switches the display unit to display the image for recording from ablackout state, after an end of exposure processing and frame memorystorage processing of the image for recording.

-   -   (12) The imaging apparatus according to any of (1) to (11), in        which

the imaging element is included in an imaging device including as aconstituent element

an AD conversion unit that executes AD conversion processing on anoutput signal of the imaging element, and

a frame memory that stores a digital signal generated by the ADconversion unit.

-   -   (13) An image processing method to be executed in an imaging        apparatus,

the imaging apparatus including

an imaging element,

a frame memory that stores an acquired image by the imaging element,

a display unit that displays a stored image of the frame memory, and

a control unit that performs control of processing to be executed in theimaging apparatus,

the image processing method including,

by the control unit, starting exposure preparation processing of animage for recording in response to input detection of image-capturingoperation, and performing display control to cause the display unit todisplay an image for displaying having been stored in the frame memoryunit until display of the image for recording is enabled.

-   -   (14) A program that causes an imaging apparatus to execute image        processing,

the imaging apparatus including

an imaging element,

a frame memory that stores an acquired image by the imaging element,

a display unit that displays a stored image of the frame memory, and

a control unit that performs control of processing to be executed in theimaging apparatus,

the program causing the control unit to

start exposure preparation processing of an image for recording inresponse to input detection of imaging operation, and perform displaycontrol to cause the display unit to display the image for displayinghaving been stored in the frame memory until display of the image forrecording is enabled.

Furthermore, the series of processing steps described in thespecification can be executed by hardware, software, or a combination ofboth. In the case of executing processing by software, it is possible toinstall and execute a program recording the processing sequence in amemory in a computer incorporated in dedicated hardware, or to installand execute the program in a general-purpose computer capable ofexecuting various types of processing. For example, the program can berecorded in a recording medium in advance. In addition to installingfrom the recording medium to the computer, the program can be receivedvia a network such as a local area network (LAN) or the Internet, andinstalled in the recording medium such as a built-in hard disk.

Note that, the various types of processing described in thespecification are not only executed in chronological order in accordancewith the description but also may be executed in parallel orindividually depending on the processing capability of the device thatexecutes the processing or depending on necessity. Furthermore, in thisspecification, the term “system” is a logical group configuration of aplurality of devices, and is not limited to the one in which the devicesof each configuration are in the same housing.

INDUSTRIAL APPLICABILITY

As described above, according to the configuration of the embodiment ofthe present disclosure, the apparatus and the method are implementedthat perform display control to avoid the blackout of the display unitat the time of capturing an image for recording.

Specifically, for example, the apparatus includes an imaging element, aframe memory, a display unit, and a control unit, and the control unitstarts exposure preparation processing of an image for recording inresponse to input detection of image-capturing operation on the imagingapparatus, and executes exposure processing of the image for recordingin the imaging element and storage processing of the image for recordingin the frame memory after completion of the exposure preparationprocessing. Moreover, the control unit stops exposure of an image fordisplaying of the imaging element with the start of the exposurepreparation processing, and displays the image for displaying on thedisplay unit until display of the image for recording is enabled, toavoid the blackout.

With these pieces of processing, the apparatus and the method areimplemented that perform display control to avoid the blackout of thedisplay unit at the time of capturing the image for recording.

REFERENCE SIGNS LIST

-   11 Optical lens-   12 Imaging element-   13 AD conversion unit-   14 Frame memory-   15 Signal processing unit-   16 Memory-   21 Display unit-   22 Recording unit-   101 Optical lens-   102 Imaging element-   103 AD conversion unit-   104 Frame memory-   105 Signal processing unit-   106 Memory-   107 Display unit-   108 Recording unit-   109 Operation unit-   110 Control unit-   121 First frame memory (FM1)-   122 Second frame memory (FM2)-   200 Imaging apparatus-   210 Imaging device-   211 Imaging element-   212 AD conversion unit-   213 Frame memory-   251 First frame memory (FM1)-   252 Second frame memory (FM2)

The invention claimed is:
 1. An imaging apparatus, comprising: animaging element configured to acquire a first live view image; a firstframe memory configured to store the first live view image acquired bythe imaging element; a display unit configured to display the first liveview image stored by the first frame memory; and a control unitconfigured to: start an exposure process for a second live view image inthe imaging element; execute a display reservation process for thesecond live view image; detect an input of an image-capturing operation,wherein the first live view image is displayed at a time of thedetection of the input of the image-capturing operation; start anexposure preparation process of a capture image based on the detectionof the input of the image-capturing operation; stop the exposure processfor the second live view image based on the start of the exposurepreparation process of the capture image; cancel the display reservationprocess for the second live view image based on the start of theexposure preparation process of the capture image; and control thedisplay unit to continuously display the first live view image on thedisplay unit, wherein the first live view image is continuouslydisplayed until enablement of display of the capture image.
 2. Theimaging apparatus according to claim 1, wherein the control unit isfurther configured to execute an exposure process of the capture imagein the imaging element after completion of the exposure preparationprocess of the capture image.
 3. The imaging apparatus according toclaim 1, further comprising a second frame memory, wherein the imagingelement is further configured to acquire a plurality of live viewimages, the plurality of live view images includes the first live viewimage and the second live view image, and the plurality of live viewimages is alternately stored in the first frame memory and the secondframe memory.
 4. The imaging apparatus according to claim 3, wherein thecontrol unit is further configured to: copy the first live view image;store, based on the detection of the input of the image-capturingoperation, the copied first live view image in the second frame memory;and control the display unit to continuously display the copied firstlive view image on the display unit.
 5. The imaging apparatus accordingto claim 2, wherein the control unit is further configured to store thecapture image in the first frame memory based on the execution of theexposure process of the capture image.
 6. The imaging apparatusaccording to claim 5, wherein the control unit is further configured toswitch a display image of the display unit from the first live viewimage to the capture image based on the storage of the capture image inthe first frame memory.
 7. The imaging apparatus according to claim 1,wherein the control unit is further configured to: determine, based onthe detection of the input of the image-capturing operation, a period ofexposure of the capture image in the imaging element is one of less thana threshold value, or greater than or equal to the threshold value; andexecute, based on the determination that the period of exposure is lessthan the threshold value, display control to avoid a blackout of thedisplay unit.
 8. The imaging apparatus according to claim 1, furthercomprising an imaging device that includes: the imaging elementconfigured to further output a signal; an analog/digital (AD) conversionunit configured to: execute an AD conversion process on the signal ofthe imaging element; and generate a digital signal based on the ADconversion process; and the first frame memory configured to furtherstore the digital signal generated by the AD conversion unit.
 9. Animage processing method, comprising: in an imaging apparatus: acquiring,by an imaging element of the imaging apparatus, a first live view image;storing, by a frame memory of the imaging apparatus, the first live viewimage acquired by the imaging element; displaying, by a display unit ofthe imaging apparatus, the first live view image stored by the framememory; starting, by a control unit of the imaging apparatus, anexposure process for a second live view image in the imaging element;executing, by the control unit, a display reservation process for thesecond live view image; detecting, by the control unit, an input of animage-capturing operation, wherein the first live view image isdisplayed at a time of the detection of the input of the image-capturingoperation; starting, by the control unit, an exposure preparationprocess of a capture image based on the detection of the input of theimage-capturing operation; stopping, by the control unit, the exposureprocess for the second live view image based on the start of theexposure preparation process of the capture image; canceling, by thecontrol unit, the display reservation process for the second live viewimage based on the start of the exposure preparation process of thecapture image; and controlling, by the control unit, the display unit tocontinuously display the first live view image on the display unit,wherein the first live view image is continuously displayed untilenablement of display of the capture image.
 10. A non-transitorycomputer-readable medium having stored thereon computer-executableinstructions which, when executed by an imaging apparatus, cause theimaging apparatus to execute operations, the operations comprising:acquiring, by an imaging element of the imaging apparatus, a first liveview image; storing, by a frame memory of the imaging apparatus, thefirst live view image acquired by the imaging element; displaying, by adisplay unit of the imaging apparatus, the first live view image storedby the frame memory; starting, by a control unit of the imagingapparatus, an exposure process for a second live view image in theimaging element; executing, by the control unit, a display reservationprocess for the second live view image; detecting, by the control unit,an input of an image-capturing operation, wherein the first live viewimage is displayed at a time of the detection of the input of theimage-capturing operation; starting, by the control unit, an exposurepreparation process of a capture image based on the detection of theinput of the image-capturing operation; stopping, by the control unit,the exposure process for the second live view image based on the startof the exposure preparation process of the capture image; canceling, bythe control unit, the display reservation process for the second liveview image based on the start of the exposure preparation process of thecapture image; and controlling, by the control unit, the display unit tocontinuously display the first live view image on the display unit,wherein the first live view image is continuously displayed untilenablement of display of the capture image.